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Abstract 

A theoretical analysis, aimed at characterizing the degradation induced by the 
resampling and requantization processes applied to band-limited Gaussian sig- 
nals with flat power spectrum, available through their digitized samples, is pre- 
sented. The analysis provides an efficient algorithm for computing the complete 
joint bivariate discrete probability distribution associated to the true quantized 
version of the Gaussian signal and to the quantity estimated after resampling 
and requantization of the input digitized sequence. The use of Fourier transform 
techniques allows deriving approximate analytical expressions for the quantities 
of interest, as well as implementing their efficient computation. Numerical ex- 
periments are found to be in good agreement with the theoretical results, and 
confirm the validity of the whole approach. 
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1. INTRODUCTION 

Modern signal processing consists of algorithms applied to sequences of num- 
bers, obtained by analogue to digital (A/D) conversion of analogue signals. The 
A/D conversion implies sampling in time domain and amplitude quantization, 
the second step being mandatory due to the finite length of the registers used for 
storing the samples amplitude in the processing machine. If the effect of quan- 
tization is disregarded, the exact reconstruction of the analogue signal from its 
samples is guaranteed by the sampling theorem, under the assumption that the 
signal itself is band-limited. Conversely, when quantization is applied, the exact 
reconstruction of the signal from the quantized samples is no longer possible. 

An important signal processing task is the rate conversion applied to a se- 
quence of numbers representing a digitized signal. This task consists in obtaining 
samples of a signal taken at a certain rate, say I/T2, based on the samples of 
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the same signal available at a different rate, say 1/Ti. This problem was exten- 
sively studied in the past years, for both rational and irrational values of the 
ratio T2 /T\ , assumed to be either larger (interpolation problem) or smaller (dec- 
imation problem) than unity [l], 0, H, 13] • The above cited papers derive powerful 
techniques ensuring that the rate conversion is performed without degradation 
in all treated cases, under the assumption that the signals are not quantized. 

In a non ideal condition, the input sequence available at rate 1/Ti and the 
output sequence obtained at rate 1/T 2 as result of the rate conversion pro- 
cess are both quantized, in general (but not necessarily) according to the same 
quantization scheme. Requantization associated to rate conversion is applied 
in different contexts, like for example to signals received from radio sources in 
many applications of radio astronomy [B|, [y] , or to coded video data in image 
processing In such cases it is of interest to establish theoretical bounds for 
the degradation occurring due to the quantization process, affecting both the 
input and the output sequences of numbers. 

The inclusion of quantization effects within the context of rate conversion 
was studied by the authors, in the specific case of extreme clipping, when only 
the sign of the analogue signal is recorded, i.e. when only one bit of information 
is associated to the amplitude of each sample 8]. Under this hypothesis, and 
assuming that the input analogue signal is a realization x(t) of a band-limited 
Gaussian process X with flat power spectral density within the supporting band- 
width, results in closed form could be obtained about the degradation effect, 
in that context identified with the probability of error between the quantized 
version of x(t) at any instant of time estimated through the available quantized 
samples, and the true quantized value of x(t) (the "target"). 

The present paper is devoted to extending the results of Ref. to the case of 
arbitrary quantization scheme, including multiple output levels, with the unique 
constraints of antisymmetry of the non-linear quantization function. The above 
mentioned probability of error, which was the metric used for quantifying the 
degradation effect in the binary case, is replaced by a complete bivariate discrete 
probability distribution or, in the case of large number of outputs, by the cross- 
correlation coefficient between the estimated quantized value of x(t) and the 
target. 

2. PRELIMINARIES 

Let X be a stochastic process with real realizations x(t), which is stationary 
and ergodic, with zero mean value and Gaussian statistics. The process is 
supposed to be band limited (BL for short), with flat power spectrum within 
the supporting bandwidth [— W, W]. On denoting by a the standard deviation 
of the process, it is well known that[9( 



where T = 1/2W is the inverse of the Nyquist frequency, the sine function is 
defined by sinc(£) = sin(7r^)/(7r^), and the symbol (•) represents the expected 
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value of its argument. Samples of the signal x(t) are taken at known instants 
kT, so that Xk = x(kT) denotes the kth sample. It is known that the signal 
x(t) can be expanded (in a mean-square sense) as [§] 
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»(*)= XfcSinc ( - ^ j. (2) 

After the sampling, a quantization of the continuous value is performed, via 
a nonlinear function f{x), so that the final output, say the sequence {u m }, can 
be expressed as follows: 

u m = f(x m ), m = 0,±1,±2, . . . (3) 

The function / is assumed to be an antisymmetric, piecewise function with an 
even number of outputs, i.e., none of the output levels equals zero. For 2M 
output levels we denote the (positive) discontinuity points by = a>\ < 0,2 < 
. . . < cim < a>M+i = °°i as shown in Fig. Q] where f(x) is plotted for x > 0. 
Note that the output levels y\ < y% < . . . < um are also reported. 

Of course, the case of quantization functions with odd number of levels can 
be treated as well, by using the same methodology we are going to present. 

We study the degradation associated to the reconstruction of the digitized 
version of the signal x(t) at a time not belonging to the sampling grid kT, based 
on the knowledge of its digitized samples u m given in Eq. ([3]) . In view of the 
stationarity of the process X, such a problem consists in finding an estimate, say 
u(X), of the target value /[i(AT)j, where A e [0, 1] is a dimensionless parameter. 
To this aim, we first assume that a sine interpolation is used to estimate x{\T), 
and then the quantization function / is applied. The validity of this approach 
was demonstrated in Ref. for any antisymmetric non linear function /. 

Following the notations and results given in Ref. [8(, the estimation of the 
digitized sample u(X) can be written as 

u(A) = /KA)], (4) 

where 
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w(X) = A f ^2 u i ( 5 ) 

i=— 00 



with 

_ (xf(x)) 

Af ~ M' (6) 

and 

4>i = sine (A — i). (7) 

In general, u(X) differs, even in a mean-square sense, from the target value 
f[x(XT)]. The effect of the degradation can be accounted for by determining 
the bivariate discrete probability distribution Pij, equal to the probability that 
u = yj when the target is equal to j/,, i.e., 

Pitj = Pi{f[x(XT)\ = Vl and fi(A) = yj}, (8) 
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for i,j = ±l,±2,...,±M. 

The task of our analysis is therefore to evaluate the discrete probability 
distribution of Eq. as a function of A, for the most general case of M > 1. 
The cross-correlation coefficient between the estimated and the target values 
will also be evaluated, from which the resampling and requantization-induced 
degradation could be easily inferred. 



3. THEORETICAL ANALYSIS 



The aim of the present section is to show the theoretical basis of our approach 
for solving the problem stated in the previous section. We retrieve the bivariate 
probability distribution in Eq. (jSJ) by first evaluating its mixed moments up to 
the order 2M—1, which is sufficient for the distribution to be fully reconstructed. 
The subsequent step concerns the evaluation of the mixed moments, which is 
achieved by employing a powerful and efficient method, making use of Fourier 
transform (FT for short) techniques. 



Consider the mixed moments, say fJ, n , m , defined as 



(f(x) n fM 



(9) 



with n, m = 0, . . . , 2M — 1. Note that, due the antisymmetry of /, the moments 
vanish whenever n and m have different parity. The bivariate probability dis- 
tribution pi j can be arranged as a 2M x 2M matrix, say P, which is defined 

as 

P-M-M ■ ■ ■ P-M.-l P-M,l ■ ■ ■ P-M.M 



P-l-M 
Pl-M 



P-1,-1 P-1,1 
Pl,-1 Pi, I 



P-1,M 
Pl,M 



(10) 



Pm,-m ■ ■ ■ Pm-i Pm,i ■ ■ ■ Pm,m 

By definition, the mixed moments are related to the bivariate distribution ac- 
cording to the relation 

^n,m = ^Pi,jViVf, (11) 
i,j 

which can be cast in a matrix form 



YPY* 



(12) 
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where the dagger denotes the transpose and the 2D matrices /x and Y arc defined 

b y 

/J-0,0 ■ ■ ■ M0,2M-1 



(J>2M-l,0 ■ ■ ■ M2M-1.2M-1 



(13) 
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respectively. Since Y is a Vandermonde matrix, and since all y^'s are different, 
its inverse is always defined, so that the whole bivariate probability distribution 
P is trivially given by 

P=Y- 1 /i(Y t )- 1 . (15) 

Concerning the correlation coefficient, this can also be derived from the knowl- 
edge of the mixed moments defined in Eq. ((9J in the following way: 



Mi,i 



y/fJ-0,2 M2,0 



(16) 



The evaluation of the mixed moments \i n ,m pertinent to a typical 2M-levels 
quantization function is not a trivial task. Similarly to the approach used by 
Banta for evaluating autocorrelation functions of quantized signals [Io| , we make 
use of a FT technique. We start from the FT of the function [f(x)] n , say F n (p), 
which is defined by 



[/(*)]" = 



+ OC 



F n (p) exp(27rixp) dp, 



(17) 



F n (p) = T{[f{x)] n ) = / [/(*)]" exp(-2^ixp) Ax, (18) 

J —OQ 

with denoting the Fourier transform operator. In Appendix [A] 



where F n (p) denotes the Fourier transform of [/(x)] n , i.e., 

/• + 00 
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it is shown that 

^ Af— 1 

Vm s (p) + — ^2 (Vj ~ Vj+x) sin(27rOj- + ip), n even, 

(19) 



*W(p) = { 



TP ,- =1 



-— + — V - y"+i) cos(27ra J+ ip), n odd, 
7ip 7ip ^-J J J 



where 5(p) denotes the Dirac distribution. 

As far as the moment fi n m is concerned, on susbstituting from 
Eq. ([17]) into Eq. © we have 



/+oo /-t-OO 
/ F n (p) F m (p) exp[i27rx(AT)p] exp[i27rw(A)p'] dp dp'), 
-oo J — oo 

(20) 

where the dependence on A has been made explicit. Finally, on inter- 
changing the integrals with the averages, we obtain 

r + oo r + oo 

M„,m= / / F n (p)F m ( P ')(ex P {2Tri[x{XT) P + w{X) P ']})dpdp'. (21) 



The quantity in the average can be written, starting from Eqs. @ and (J3J), as 

(exp{27ri[a;(AT> + ™(Ay]}) = (exp j 2th ^ z fc j ) , (22) 

where the zero-mean, statistically independent, random variables 

z k = (j> k [x k p + A f f{x k )p'} , (23) 

have been defined. Moreover, due to the above statistical independence, we 
have 

(exp(i2^Z)) = J] <cxp(i2^z fe )), (24) 

k— — oo 

where 



z= J2 zk - ( 25 ) 



k— — oo 

As we will see shortly, the average in the r.h.s. of Eq. (|24|) can be calculated, 
for any k, for the considered class of quantization functions. However, the pres- 
ence of the infinite product does not allow an exact closed form for the mixed 
moments to be provided and makes their numerical estimation cumbersome. In 
order to overcome such difficulties, we are going to implement suitable approx- 
imations which will simplify the derivation of the moments. 

First of all, it should be noted that the random variables z k are 
not normally distributed and, due to the prefactor are also not 
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identically distributed, being a 2 Zk — > for fc — > ±00. The evaluation of 
the probability distribution function of infinite sums of not identically 
distributed indipendent random variables represents a task f ar from 
be i ng trivi al, as witnessed by past and current literatures [11, [Til Il3l 
B EE ES E3, and is beyond the scope of the present work. In 



particular, it is clear that the use of the central limit theorem cannot 
be invoked to find the probability density function of Z. To give a 
simple evidence of this, consider the case A = 0, for which <f>k = <5o,fcj 
and thus Z = zo that, as said above, is not normally distributed, unless 
p' = 0. In the general case A 7^ 0, we use the approach outlined in Ref. 
[14] . so that the random variable Z is first written as the sum of two, 
statistically independent, random variables, say Zc and Zj, defined 
as 

Z c = Y\ *k, (26) 



and 



fcSAf 



respectively, with JV being a suitable finite set of N consecutive in- 
dices, J\f = {it, £2, • • ■ , In}- In particular, we choose 

( {-h+l,-h+2,...,h-l,h}, h>0 
N(h) = I (28) 
[9, h = 0, 

with N = 2h being the number of consecutive indices forming the set.Q 
In the above decomposition, the variable Zc retains the coefficients <frk 
for which fc is close to the interval of interest of A, while the variable 
Zj corresponds to the tails of the sum in Eq. (| 2 5 [) . with coefficients 
4>k such that |0fc(A)| is slowly varying with respect to k, being 

l«A)| < (29) 



which, for large values of |fe|, goes like l/\k\. Following Ref. [14|, we 
assume that Zj retains approximately a normal distribution, so that 

(exp(i27rZ/)) ~ exp(-27r 2 cr| / ), (30) 

where the variance a\ — (Zj) is 

a%. =p 2 P I + Qj(p' 2 + 2p P '), (31) 



1 The explicit dependence of the set on the variable h will not be shown in the subsequent 
formulas. 
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with 

P, 



qj = 4 e ^(/ 2 (^)) = 4 </ 2 > fi-E . ( 33 ) 

where the fact that 2_. 4% = 1 nas been used. In Sec. [5j in order to minimize the 

fc 

computational effort, we have used the above decomposition with the minimum 
possible value of h, i.e., h = 1 and Af = {0, 1}. As we will see, such a choice 
provides quite satisfactory results. As far as the Zc is concerned, this variable is 
now defined as a sum of a finite number of terms, which makes not prohibitive 
the computation of the quantity (exp(i2-7rZc7)), as required by Eq. (135p . In 
particular, in Appendix [Bl it is shown that 



(exp(i2^ c )) = exp ( -2ttVV E <t>i J 



II E E E J^ 1 ) 9 exp(i27r S ^ /% ^p') (34) 



. 2 

fceTV j s « 



x erf 



gj +g - i 2n s 4> k a 2 p 

775 



where erf(-) denotes the error function j — l,...,Af, s S {— 1, +1}, and 

?e{0,l}. 

(exp(27ri Z)) = (cxp(2vri Z c )) (exp(27ri Z,)) , (35) 

where 

Accordingly, on recalling Eq. (|3H)l . through Eqs. (f5T|) - ([5H|) we eventually 
found 

(exp(i27rZ)) « exp [-27r 2 (<j 2 p 2 + Q?p' 2 + 2Qjpp')] 



II E E E l^ 1 ) 9 «p(iW /Vi &,/) 

^ (36) 



x 

fcGA^ j s g 



x erf 



a, + „ - i 27r s <fo a 2 p 



aV2 

It is not difficult to show that, once Eqs. (|36[) and (fT9|) are substituted into 
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Eq. (f2"Tj) . the mixed moments take the following form (see Appendix |C|) : 

M-l 

3=1 

M-l 

+ E 2>W -y£i)Z (e ' 2) (^+i) (37) 
3=1 

Af— 1 M-l 

+ E E (f? - (y™ - vT+i^HZi+i'fy+i)* 

3=1 3'=1 

for even n and m and 
M-l 

- E -i/i+i)^ o) (ai+i.o) 

3=1 

M-l (38) 

-E iW -^i) j(0) (m;+i) 

i=i 

M-l M-l 

+ E E Cw? - fi+i) (»F - ^(%+i^Wi), 

3=1 3'=1 

for odd n and m, where the functions •), X^ 6,1 ' (■), X( e ' 2 )(-), and Z( e,3 '(-, •), 

together with the symbols aj and a'j +1 are defined in Appendix Id 

4. THEORETICAL RESULTS 

The evaluation of the moments could be carried out, through Eqs. (|37[) 
and (|38p . for arbitrary antisymmetric quantization functions of the form of 
Fig. [2 However, in the examples we are going to show, we used the quantization 
schemes identified by Max as the results of an optimization process aimed at 
minimizing the distortion resulting from quantization (l9| . For convenience, the 
geometries of the above quantization schemes are reported in Tab. [T]for values 
of M up to 4. 

Presenting the results related to the whole bivariate probability distribution 
is a nontrivial task due to the discrete and 2D character of the distribution 
itself. We decided to present two examples of the pij distribution for M = 4 
and for two fixed values of A, namely A = 0.05 and A = 0.5, which are reported 
in Tabs. [2] and [3l respectively. 

A meaningful parameter quantifying the amount of degradation induced by 
the quantization and resampling processes is the cross-correlation coefficient, 
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defined in Eq. (HHJ), whose behavior, as a function of A, is plotted in Fig. [2] for 
M = 1, . . . ,4. Note that, due to symmetry reasons, only the interval [0, 1/2] of 
A is shown. 

As a general remark, it should be noted that, on increasing the number of 
quantization levels, the correlation coefficient increases approaching 1 and dis- 
plays a plateau whose extension approaches the whole A interval. Both behav- 
iors are expected, and they account for the fact that, for dense and non-clipping 
quantization schemes, f(x) — ► x. 

Although the methodology presented so far provides a complete solution 
to the problem under investigation, the involved computational effort increases 
proportionally to M . As a matter of fact, its use for large values of M, i.e., for 
dense quantization schemes, is made difficult by practical constraints related to 
the computation time required for evaluating all involved integrals and to the 
numerical stability of the final results. In fact, a possible drawback occurs when 
the Vandermonde matrix in Eq. (fT4|) has to be inverted for large values of M, 
to derive the full bivariate probability distribution. In this case, however, it is 
preferable to deal with the problem in terms of the cross-correlation coefficient, 
which provides an adequate description of the degradation effect. 

5. COMPARISON WITH NUMERICAL SIMULATIONS 

We performed numerical simulations aimed at quantitatively verifying the 
theoretical results presented in Sec. [4] 

In Fig. [3] a schematic block diagram explaining the methodology adopted 
for the simulations is sketched. A sequence of random numbers normally dis- 
tributed with unit variance and zero mean is generated, representing the samples 
of a realization of a Gaussian process X taken at the sampling period which is 
identified as 1 sec. By construction, the process X is BL between -1/2 and 1/2 
Hz. The samples {xk} are used, along two parallel signal paths, to generate 
the values of f[x(X)] and f[w(X)} according to the reconstruction formulas (2) 
and (5). Only a finite number of terms is used for reconstruction; the adopted 
selection of 200 terms is justified in Appendix |Pl The values /[x(A)] and f[w(X)] 
are then used to estimate the mixed moments /x n , m and the discrete probabil- 
ity pi independently In particular, pij has been evaluated by counting the 
events /[x(A)] = y% and f[w(X)] = yj for a large number of realizations (in the 
order on 10 5 ). The mixed moments have also been estimated by averaging the 
product f n (x) f m (x) over the same number of realizations, in order to verify 
the theoretical predictions about the correlation coefficient. 

Tables [4] and [5] give the bivariate discrete probability distribution estimated 
from numerical simulations corresponding to the case M = 4, for A = 0.05, and 
A = 0.5, respectively. They have to be compared to tables and O respec- 
tively. As we can see, the agreement between the theoretical and experimental 
probability distributions is very good. 

As far as the correlation coefficient is concerned, Fig. [4] shows the extremely 
good agreement between the theoretical values of p plotted in Fig. [2] (solid 
curves) and the experimental results obtained by numerical simulations (circles). 
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Before concluding the present section, it is worth providing some details 
about the choice of the number of samples used in the reconstruction formula 
of Eq. |5]). To this aim, Appendix [Dl contains a detailed analysis concerning 
the way the truncation of the series in Eq. (0 affects the degradation of the 
reconstructed signal. In particular it is confirmed, by suitable numerical experi- 
ments, that a number of samples of about 200 is enough to validate the excellent 
agreement between theory and experiment previously displayed. 

6. AN APPLICATION TO DIGITAL SIGNAL PROCESSING 

In the present section we illustrate a practical application of our theoretical 
results. We review the problem of the sampling rate increase (interpolation), 
making reference to the classical theory by Schafer and Rabiner [![. In par- 
ticular we show how the degradation originated from the re-sampling and re- 
quantization processes can be accounted for by using the theoretical expressions 
presented in Sec. [31 

We start from the top part of the block diagram of Fig. [5] The signal x(t), 
defined in Sec.[2j is first sampled at the rate 1/T. The obtained sequence {xk} 
is then interpolated and quantized, producing the output sequence {u m }. The 
sampling rate associated to the sequence {u m } is where T'/T = D/L, with 
D and L being integer numbers greater than 1, with D < L0 The change of the 
sampling rate from 1 /T to 1 /T' is operated according to the prescriptions given 
in Ref. [l[. More precisely, after the first block the sampling rate is increased 
by the integer factor L, by inserting a sequence of L — 1 zero- valued samples 
between any two consecutive elements of the original sequence. The sequence so 
obtained is filtered through an ideal low-pass filter having a normalized cutoff 
frequency tt/L and gain L. The output of the filter, is decimated by selecting a 
sample every D and eventually quantized by the function /. Following Ref. [l(, 
it is possible to show that the relation between the input sequence {xk} and the 
output sequence {u m } is given by 



where A m = — m. 

In the bottom part of Fig. [51 the same processing scheme is adopted assuming 
that the signal x(t) is only available through its digitized samples {f(xk)}- The 
input sequence {f(xk)} is suitably scaled by the normalization factor Af, which 
will be set to one, assuming the use of an ideal quantizer / [l9[. The outcome 
of this processing is now represented by the sequence {u m }, where 




(39) 



D 




(40) 



2 We limit ourselves to the case of interpolation, for which T" < T. 
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We note that Eq. (pfD|) coincides with Eqs. (g]) and ([5]), so that we can apply 
our theoretical results to the present situation. Each element of the sequence 
{u m } is a degraded version of the corresponding element of the sequence {u m } 
(the target). Such a degradation is not stationary with respect to the "time", 
represented by the index m. In fact, when mD/L is an integer number there 
is indeed no degradation, whereas when the same quantity has fractional part 
equal to 1/2, we know that the degradation is maximum (see Fig. [2]). 

The overall degradation between the two sequences can be quantitatively 
accounted for by the 0-delay temporal degree of coherence, say 7, which is 
defined by 

(41) 



where the bar denotes the temporal (i.e., m) average. The above definition can 
be used, provided that it is shown to be independent of the particular realiza- 
tion x(t). After straightforward algebra, it is possible to prove the following 
theoretical expression for 7, in terms of the mixed moments /i n ,m, defined in 
Eq. ©: 

1 

=, (42) 



7 = 



\ 



L-1 



j Y Mo,2(A l ) 



where A,- = i/L, (i = 0, . . . , L — 1), and the fact that /12.0 does not depend on 
A has been made explicit. It should be noted that, for the treated interpolation 
problem, only the value of L is relevant for the degradation. 

The quantity in Eq. (|4ip is easily measurable by implementing the block 
diagram of Fig. [6l whereas expression in Eq. |42|) is purely theoretical, based on 
the expression of the moments obtained in Sec. [3] To provide the experimental 
verification of the identity between the two equations, the various DSP blocks 
of Fig. [5] have been implemented. In particular, a FIR filter has been used to 
implement the filter block, based on windowing the ideal impulse response cor- 
responding to a rectangular transfer function by a Hamming window, similarly 
as we did in Ref. [§]. Values of 7 obtained for values of L from 2 up to 30, 
and for various values of D, have been experimentally evaluated and reported 
is Fig. for M — 1,2,3,4. Solid curves represent the theoretical values 
provided by Eq. (|42|) . The agreement is excellent. 



7. CONCLUSIONS 

The purpose of this paper was to extend the studies about the rate conver- 
sion applied to signal sequences, by taking into account the degradation effect 
associated to the quantization process. 
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In particular, we addressed the problem of computing the degradation in- 
duced by the resampling and re-quantization of a BL stationary and ergodic 
signal with Gaussian statistics and flat power spectrum within the supporting 
bandwidth, available through its quantized samples. 

The analysis provides the algorithm for quantitatively characterizing the 
degradation effect induced by the resampling and re-quantization processes in 
terms of the knowledge of the complete bivariate discrete probability distribu- 
tion associated to the target and the estimated quantized signals, or in terms of 
the correlation coefficient between the two quantities. The analysis makes use 
of FT representation of the quantization function and of its powers, to allow 
the application of linear analysis techniques. Numerical experiments have also 
been implemented in order to validate the theoretical methodology and results. 
The comparison showed an excellent agreement between theory and simulations. 
Finally, we provided an example of application of our theoretical results to an 
important area of Digital Signal Processing, the sampling rate conversion. 

The class of stochastic processes considered in the present paper represents a 
fundamental model with important applications in radio astronomy, where the 
received noise-like signal originated from radio sources can be modeled, after 
filtering, with good accuracy by the ideal process here analysed. In such appli- 
cations coarse quantization (1 or 2 bits) is commonly applied, and the obtained 
sequences are often subject to resampling and requantization. Of course, the 
results obtained in the present paper must be interpreted as a first step to- 
ward the extension of the methodology originally developed in Ref. [|| to other 
important classes of stochastic signals. Within the same perspective another 
important topic, which will be the subject of forthcoming studies, concerns the 
development of an asymptotic analysis dealing with the case of dense and no- 
clipping quantization schemes, aimed at deriving closed-form limit expressions 
describing the degradation effect. 

Finally, we wish to suggest a possible, future extension of our 
work which also could be of interest for the radio-astronomy com- 
munity. In particular, we refer at the classical problem in very large 
baseline interferometry (VLBI), of different antennas observing the 
same object and producing digitized representations of the received 
signal which are then cross-correlated to extract observables of inter- 
est. The decorrelation induced by the quantization process has been 
studied in various works in the past, for example in Ref. [20]. We now 
think to the case, presently of practical interest, where the received 
downlink signal is digitized at the different antennas according to dif- 
ferent sampling and quantization schemes. In such a case the data 
streams have to be brought to a common quantization scheme and 
sampling rate prior to cross-correlation. We believe that the addi- 
tional de-correlation induced by the re-sampling and re-quantization 
can be studied by use of the methods exposed in our paper. 
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A. Derivation of Eq. (fT9|) 

We start from Eq. (|18p which, by FT inversion, gives 



Fn(p) 



+ 00 



[f(x)] n exp(-i27rpx) dx, 



(43) 



where, due to the piecewise character of the quantization function, 



M-l 



(y?+i-v?) rect 



2a 



M_1 ( x \ 

J/m sign(o:) - 2J (vf+i ~ Vj) sign(x)rect J 



where the function rect(x) is defined as 

r i. n<i/2, 

rect(x) = < 

1 0, \x\ > 1/2, 

and sign(x) denotes the signum function, i.e., 

1, x > 0, 



sign(x) 



-1, x < 0, 



0, £ = 0. 

Furthermore, on taking into account that 



and 



^{sign(,)rect(£)} 



/ a; \ 1 sin(27rap) 
\2a~J. ~ " 



717; 



= T < rect 



x — a/2 



< rect 



x + a/2 



-2i sin 
i 



2i 



(nap) T { rect ( — ) \ = sin 2 (nap) 

I V a / J np 

— [1 — cos(27rap)l, 
np 

after some algebra Eqs. (|43j) and (f44j) lead to Eq. (fl9]) . 



n even, 



odd, 



(44) 
(45) 



(46) 



(47) 



(48) 
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B. Derivation of Eq. ([34]) 

We start from 



where 



(cxp(27riZ c )) - Y[ ip k (p,j/), 
ipk(p>p') = (exp{27ri0 fc [x k p + A f f(x k )p']}) 



+ 00 



p x (x) exp{27ri0 fc [xp + Af f(x)p']}dx, 



(49) 



(50) 



where p x (x) is the pdf of the Gaussian process X. Due to the piecewise character 
of the f(x), Eq. ([50f can be written as 



4>k(p,p') =22 / Px(x) exp{2ni(f>k[xp + Afyjp']}dx 

• 1 J at 



3 = 1 " u 3 



(51) 



M a . 

2J / Px(z) exp{27ri0 fc [xp - Af yjp'}} dx. 



Furthermore, on changing the integration variable x in —x in the second integral, 
after trivial algebra we obtain 



tpk{p,p') = 



= y ^ exp(27ri 4>t Af yj p') I p x {x) exp(27ri<^fc xp) dx + c.c. 
.7=1 J** 



(52) 



where c.c. stands for complex conjugate. The last integral can be analytically 
expressed in terms of error function, and precisely 



r a i+i 1 
/ Px{x) exp(27ri0fc xp) dx — — exp(— 2ir 2 <j) 2 .o- 2 p 2 ) 
J a,j 2 



erf 



dj+i - 2m<f) k a 2 p'\ ( dj - 2m<p k a 2 p 



(53) 



V2a 



V2a 



On substituting from Eq. (|53p into Eq. (|52p . and on introducing two binary 
indices, say q S {0, 1} and s G { — 1, 1}, we have 



ipk(p,p') = - exp(-2vr 2 4>%a 2 p 2 ) 



x ^ 9 exp(2?T is^kAfyjp') erf 



Oj +g — 2i s TT(j>kCr 2 p 
V2a 



(54) 



Finally, on substituting Eq. (|54|) into Eq. (|49|). after trivial algebra Eq. ([34 
naturally follows. 
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C. Some computational remarks 

First of all, we note that Eq. ([56]) can be formally rewritten in the following 
way: 

(exp(i27rZ)) = -L exp [-2k 2 (a 2 p 2 + Q 2 p' 2 + 2Q 2 pp')] 



X E E E II cM^s k A f y ]k pi) 

j s q keM 



(55) 



x erf 



a jk+q k - i27rs fc <j) k a 2 p 



aV2 

where the vectorial indices j, s, and q are defined by 

j [jii ) 3iz > • • * ) 3%n— i ' ^at]) 

S [ s il ' 5 i2 ) * ■ ■ ) s ijv-l ' s ijv] ' (56) 

Q [lil 1 9*2 1 ■ ■ ■ 1 9'iJV-l 1 9'ijv] 1 

with j; £ {1, . . . , M}, si 6 { — 1, 1}, and <?/ € {0, 1}. The vectorial indices have 
been introduced to make the formulas more compact. The use of the indices is 
esemplificated by the following statement: 



E(-) = EE-E £(•)• 



( 5? ) 

Furthermore, we introduce two dimensionless variables, say £ and ry, in place 
of p and p', respectively, which are defined by 



£ = V2irap, 
i] = \[2t:Qip' , 



(58) 



so that Eq. ([55)1 becomes 

1 



exp(i27rZ)) = exp [-(£ 2 + r; 2 + 2a^)] 



2 M 

x E E E II ex p(^ fc s * fa »?) ( 59 ) 

j s q keM 



where 



xerf {a jk+qk -is fc </>fc£), 



*j = -^7=1 a = — . & = % • ( 60 ) 
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As far as the product F n (p) F m (p') is concerned, from Eq. (TIT)]) we have 
F n (p)F m (p') = y^ m S(OS( V ) 

M-l . e x 

+ e ^(^-^i) sm( ;r i0 ^) 

w_1 sinf2a' ( 61 ) 

+ E vSf (vf - vT+i) J+ *(0 

7T77 

3 = 1 ' 



M-l M-l 



3in(2a i+ i£) sin(2a^, +1 r?) 



3=1 3'=1 S ' 

for even values of both n and m, and 
F n {p)F m {p') = -y^ m — t — 



71"£ 7T77 

Ejf(!/?-4)^- 



M-l 



3=1 
M-l 



E tf(»r-ifri) 



3=1 
M-l M-l 



cos(2a^ +1 ?7) l 



cos 



(2a i+ i£) cos(2a;-, +1 77) 



(62) 



E E (y?-Vi + i)(y?-v?+i) 

3=1 3'=1 * ' 

for odd values of both n and m, where = a/a. 

Finally, on substituting from Eqs. ([55]) . (fBTj) and (R)2"j) into Eq. (|2~Tj) we obtain 
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Eqs. (35} and (37}, where 

iM>(a) = X;(-i) q 

j,s,q 

x / d£ exp(-£ 2 ) Sm ^ a ^ J| erf(a ifc+9fc - is fe ^ fe ), 



J(e,2) ( a = ^(_i) q erf(a' + %i) JJ erf(a Jfe+g J, 



X( e - 3 )(a,a') - £ (-l)^ Re | d£ exp(-^ 2 ) s ' m ^*0 (63) 



J,s,q 



xerf ( a' + + ia£ ) ]J erf(a Jfc+gfc - is fe ^ fc ), 



Z(°)(a,a') = £(-l) q Im | d£ exp^ 2 ) 

j,s.q 

xerf ( a' + + ia£ ) JJ erf(a jfc+9fc - is fc £0 fc ), 



fceAf 



and 



(-i) q = n (- i ) ,k . 



(64) 



D. Analysis of degradation effect in case a finite number of samples 
is used for signal reconstruction 

The reconstruction formula in Eq. (5} assumes that an infinite number of 
samples can be used for estimating w(X). In practice, the sum will be made 
over a finite number of samples, applying some type of windowing function. For 
instance, in the case of a rectangular window one has simply thalU 

w(X) = Af^Ui <f>i, (65) 

The set Q is made by consecutive indices distributed around 0, which we suppose 
including the set M defined in Eq. (|28| . In particular, it is straightforward to 



3 In the present annex we will indicate with tilde all terms which change due to the trun- 
cation. 
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show that the constant Af, which ensures minimum possible degradation, is 
still defined as in the case of infinite sum, i.e., by Eq. ([6]). 

It is not difficult to show that the theoretical analysis developed still remains 
valid, provided that the random variable Zj defined in Eq. (J27J) be replaced by a 
new random variable, say Zj, defined as the sum of two statistically independent 
terms, as follows: 

Zi = ^ z k + £^PXk <t>k- (66) 
k4g 

keg *~ 

Then, on applying a similar methodology as done for the case of Zj, one can 
assume that (exp(i27rZr)) can be approximated by exp(— 27t 2 <t| ), where 

4 7 =p 2 P I + Qj(p' 2 + 2pp / ), (67) 

and 

Q 2 i = A f </ 2 ) J>1 £ &) > ( 68 ) 

provided that 

1. a suitable set Af has been selected according to the prescriptions of Sec. [4] 
(e.g. {0,1}); 

2. Q is much larger than Af. 

The whole theoretical analysis developed in the paper is now entirely applicable 
having care to replace Qi with Qi. 

To give a numerical evidence about the effect of the finite number of sam- 
ples, Fig. [5]shows the behavior, as a function of the total number of samples, of 
the correlation coefficient, evaluated for A = 1/2 and for the 1-bit quantization 
function. The dots are representative of the outcomes of numerical simulations 
while the solid curve represents the results obtained by applying the theoretical 
analysis, together with the prescription given by Eq. (|6"5|) . It is evident that 
the agreement between the values of p obtained from numerical simulations 
and those derived through the theoretical analysis in the present annex is quite 
satisfactory even when small number of terms is used for reconstruction. Addi- 
tionally, it is also clear that selecting 200 samples in the reconstruction formula 
is well representative of the ideal condition, since the values of p have reached 
their asymptotic regime. 



4 Of course, the number of terms used for reconstructing x(\), according to Eq. (2), was 
kept constant during all simulations to the relatively large of number of 500. 
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List of Tables 
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aj (j = 1,...,M) 
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y 2 = 0.7560 
2/3 = 1-344 
?/4 = 2.152 









Table 1: Quantization schemes, taken from Ref. [Tgj . selected for testing of the theoretical 
approach. For meaning of symbols refer to Fig. [l] 
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Table 2: Bivariate discrete probability distribution p%j, defined as in Eq. JHJ, calculated for 
M = 4 and A = 0.05. indices i (rows) and j (columns) equal — M, . . . , —1, 1, . . . , M. 
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Table 3: The same as in Table [2] but for A = 0.5. 
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Table 4: Bivariate discrete probability distribution Pij, estimated from numerical simulations 
for M = 4 and A = 0.05, to be compared to Tab. [2] 
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Table 5: The same as in Table [4] but for A = 0.5. This table has to be compared to Tab. [3] 
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List of Figure Captions 



Figure 1: Geometry of the quantization function. 



Figure 2: Theoretical behavior of the cross-correlation coefficient, defined in Eq. ( 1161 . as a 
function of A, for M = 1, . . . , 4. 



Figure 3: Block diagram showing the methodology adopted for making the numerical simula- 
tions. The average in the {. . .)-block was made over 10 realizations, while the sine interpo- 
lation was performed by using 200 terms. 



Figure 4: Comparison of the theoretical results shown in Fig. [2] (solid curves) to the experi- 
mental results obtained through numerical simulations (circles). 



Figure 5: Behavior of the correlation coefficient p as a function of the total number of samples 
used for reconstructing the values of w(X) for A = 1/2. Dots are representative of the numerical 
simulations; the solid curve represents the results provided by the theoretical analysis with 
the use of Eq. I|68j l, The quantization function corresponds to the 1-bit case. 



Figure 6: A DSP application. Sampling rate conversion applied to a signal x(t) available 
through it quantized samples. 



Figure 7: Behavior of the degradation between the sequences {u m } and {u m } in Fig. [6] 
experimentally evaluated for values of L from 2 up to 30, and for several values of D. The 
theoretical prediction given in Eq. [142 t i is also shown (the theoretical points are joined 
by a solid curve which is used as a guide for the eye). The quantization functions 
correspond to M = 1 (open circles), M = 2 (black dots), M = 3 (open squares), 
and M = 4 (black squares). 
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Fig. 2 - Lanucara and Borghi 
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